How To Attain Maximum Profit In Minority Game? 
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What is the physical origin of player cooperation in minority game? And how to obtain maximum 
global wealth in minority game? We answer the above questions by studying a variant of minority 
game from which players choose among N c alternatives according to strategies picked from a re- 
stricted set of strategy space. Our numerical experiment concludes that player cooperation is the 
result of a suitable size of sampling in the available strategy space. Hence, the overall performance 
of the game can be improved by suitably adjusting the strategy space size. 
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Econophysics — the study of economic and economic 
inspired problems by physical means — is the result of 
interflow between theoretical economists and physicists. 
Using statistical mechanical and nonlinear physical meth- 
ods, econophysicists study global behaviors of simple- 
minded models of economic systems making up of adap- 
tive agents with inductive reasoning. In particular, mi- 
nority game (MG) jj], ^ is an important and perhaps the 
most extensively studied econophysics model of global 
collective behavior in a free market economy. This game 
was proposed by Challet and Zhang under the inspiration 
of the El Farol bar problem introduced by the theoretical 
economist Arthur 

MG is a toy model of N inductive reasoning players 
who have to choose one out of two alternatives indepen- 
dently according to their best working strategies in each 
turn. Those who end up in the minority side (that is, the 
choice with the least number of players) win. Although 
its rules are remarkably simple, MG shows a surpris- 
ingly rich self-organized collective behavior. For example, 
there is a second phase transition between a symmetric 
and an asymmetric phase ^|, [| . Since the dynamics of 
MG minimizes a global function related to market pre- 
dictability, we may regard MG as a disordered spin glass 
system [^|, 0. Recently, Hart et al. introduced the so- 
called crowd-anticrowd theory to explain the dynamics of 
MG H |IC[ ]. Their theory stated that fluctuations arised 
in the MG is controlled by the interplay between crowds 
of like-minded agents and their perfectly anti-correlated 
partners. The crowd-anticrowd theory not only can ex- 
plain global behavior of MG, it also provides a simple 
working hypothesis to understand the mechanism of a 
number of models extended from the MG. 

Numerical simulation as well as the crowd-antiwerowd 
theory tell us that the global behavior of MG depends 
on two factors. The first one is the product of the num- 
ber of players N at play and the number of strategies S 
each player has. The second factor is the complexity of 
each strategy measured by 2 M+1 , where M is the num- 
ber of the most recent historical outcomes that a strat- 
egy depends on. Global cooperation, as indicated by the 
fact that average number of players winning the game 
each time is larger than the case when all players make 
their choice randomly, is observed whenever 2 M+1 w NS 



[Q, [|, || ■ In fact , cooperative phenomenon is also seen in 
our recent generalization of the MG in which each player 
can choose one out of N c alternatives. More precisely, 
w NS is a necessary condition for global coopera- 
tion between players in our generalization pJj ]. 

Perhaps the two most important questions to address 
are why and when the players cooperate in MG. In fact, 
these are the questions that the crowd-anticrowd theory 
was trying to answer. On the way of finding out the an- 
swers, Cavagna believed that the only non-trivial relevant 
parameter to the dynamics of MG is M fj^] . But later 
on, Challet and Marsili revealed that historical outcomes 
also determine the dynamics of MG in general. They 
also found that information contained in the historical 
outcomes is irrelevant in the symmetric phase |Q. 

Is it true that global behavior of MG is determined 
once N, S and M are fixed? More specifically, we ask 
if it is possible to lock the system in a global coopera- 
tive phase for any fixed values of N, S and M. In this 
way, players, on average, gain most out of the game. In 
what follows, we report a simple and elegant way to al- 
ter the complexity of each strategy in MG with fixed N, 
S and M. By doing so, it is possible to keep (almost) 
optimal cooperation amongst the players in almost the 
entire parameter space. 

We begin our analysis by first constructing a model of 
MG with N c alternatives whose strategy space size equals 
N% for a fixed prime power N c . We label, for simplicity, 
the N c alternatives as the N c distinct elements in the fi- 
nite field GF(N C ); and we denote this variation of MG 
by MG(iV c ,iV£). In MG(iV c ,iVf), each of the N players is 
assigned once and for all S randomly chosen strategies. 
Each player then chooses one out of the N c alternatives 
independently according to his/her best working strategy 
in each turn. The choice chosen by the least non-zero 
number of players is the minority choice of that turn. 
(In case of a tie, the minority choice is chosen randomly 
amongst the choices with least non-zero number of play- 
ers.) The minority choice of each turn is announced. The 
wealth of those players who end up in the minority side 
is added one point while the wealth of all other players 
is subtracted by one. 

To evaluate the performance of each strategy, a player 
uses the virtual score which is the hypothetical profit for 
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using that strategy in playing the game. The strategy 
with the highest virtual score is considered as the best 
performing one. (In case of a tie, one chooses randomly 
amongst those strategies with highest virtual score.) The 
only public information available to the players is the 
output of the last M steps. A strategy s can be repre- 
sented by a vector s = (s%, S2, S3, ■ ■ ■ , sl) where L = N^ 1 
and Si are the choices of the strategy s corresponding 
to different combination of the output of the last M 
steps. In MG(iV c ,iV c 2 ), strategies are picked from the 
strategy space S = {X a v a + X u v u : A Q ,A U G GF(N C )} 
of size AT? where GF(N C ) denotes the finite field of N c 
elements and all arithmetical operations are performed 
in the field GF(N C ). The two spanning strategy vectors 
v a = («oX)Vo2, ■ ■ ■ ,v a L) and V u = (V U 1,V U 2, ■ ■ ■ ,v u l) of 
the linear space § satisfy the following two technical con- 
ditions: 



v a i 7^ for all i, 



(1) 



and by regarding i as a uniform random variable between 
1 and L, 

Pr(v ui = k\v al = j) = 1/JVc for all j, k G GF(N C ) (2) 

whenever Pi(v a i = j) ^ 0. (We remark that these two 
technical conditions are satisfied by various choices of v a 
and v u such as v a % = 1 and v U i — f(i mod N c ) where / 
is a bijection from Zjv c to GF(N C ).) 

The span of the strategy vector v a over GF(N C ) forms 
a mutually anti-correlated strategy ensemble § a since 
Eq. (^) implies that any two distinct strategies drawn 
from § a always choose different alternatives for any given 
historical outcomes. Hence, the Hamming distance be- 
tween any distinct strategies u% ^ H2 in S a equals 



d(ui,u 2 ) = L. 



(3) 



In contrast, the span of the strategy vector v u over 
GF(N C ) forms a mutually uncorrelated strategy ensem- 
ble S M since Eq. (g) and the fact that XGF(N C ) = 
GF(N C ) for all A G GF{N c )\{0} imply that any two 
distinct strategies drawn from S u always choose their 
alternatives independently for any given historical out- 
comes. In other words, the probability that any two dis- 
tinct strategies drawn from S u choose the same alterna- 
tive is equal to 1/N C . Consequently, 

d(u 3 ,u i )=L(l-l/N c ) (4) 

for any u 3 ^ U4 <E §„; and 

d(u 1 ,u 3 )=L(l-l/N c ) (5) 

for any u\ G § a and u 3 6 § M \{(0, 0, . . . , 0)}. 

More generally, using Eqs. (g)~(|5|) as well as the fact 
that d(a, b) = d(a + c, b + c), we have 

d(A a lWa + KlV u , X a2 V a + \ u2 V u ) 

= d({X a x - A a2 ] V a , [X U 2 - Xui] v u ) 

L{l-l/N c ) \iX uX ^X u2 , 

if A„i = A u2 and A ai ^ A a2 , (6) 



That is to say, the strategy space S is composed of 
N c distinct mutually anti-correlated strategy ensemble 
(namely, those with same X u ); whereas the strategies of 
each of these ensemble are uncorrelated with each other. 
(We remark that in the language of coding theory, § is a 
linear code of N% elements over GF(N C ) with minimum 
distance L(l - l/N c ).) 

We expect that the collective behavior of MG(iV c ,JV c 2 ) 
should follow the predictions of the crowd-anticrowd the- 
ory as the structure of S matches the assumptions of the 
theory. In order to evaluate the performance of players in 
MG(N C ,N^), we study the mean variance of attendance 
over all alternatives (or simply the mean variance) 



s2 = ^rEK(^W) 2 ) - (Mt))% 



(7) 



where the attendance of an alternative Ai(t) is just the 
number of players chosen that alternative. (We remark 
that the variance of the attendance of a single alternative 
was studied for the MG In fact, the variance of 

the attendance of an alternative represents the loss of 
all players in the game. The variance S 2 , to first order 
approximation, is a function of the control parameter a, 
which is the ratio of the strategy space size |§| to the 
number of strategies at play NS, alone || . 

To compare the MG(N C ,N^) with the crowd-anticrowd 
theory, we first have to extend the calculation of the vari- 
ance by the crowd-anticrowd theory to the case of N c 
alternatives. According to the crowd-anticrowd theory, 
the variance of the attendance originates from the inde- 
pendent random walk of each mutually anti-correlated 
strategy ensemble. In each of these strategy ensemble, 
the action of a strategy is counter-balanced by its anti- 
correlated strategies. Therefore, the step size of the ran- 
dom walk of a mutually anti-correlated strategy ensemble 
is equal to the difference between the number of players 
using a single strategy from the mean number of players 
using the strategies in this ensemble || |TJJ] . This random 
walk idea can be readily extended to the case of multi- 
ple alternatives. In fact, for the mutually anti-correlated 
strategy ensemble §a = {Xv u + iiv a : fx G GF(N C )}, 



step size for A x(x ^)(t) by § A 



N; 
1 



X.ji 



J2(Nx,n-Nx^) 



(8) 



L 




if A„i — X u2 and A i — X a 2- 



where is the number of players making decision ac- 
cording to the strategy Xv u + /iv a and x(A, A 1 ) i s the alter- 
native that are chosen by the strategy Xv u + fj,v a . Thus, 
the mean variance predicted by the crowd-anticrowd the- 
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ory is given by 



E 2 = 



N c ? . I N r 2 



Sa neGF{N a ) 



where 5Z§ denotes the sum of the variance over all mu- 
tually anti-correlated strategies ensemble, and ( ) denotes 
the average over time. We note that when averaged over 
both time and initial choice of strategies, variance of at- 
tendance for different alternatives must equal as there is 
no preference for any alternative in the game. 
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FIG. 1: The mean variance E versus the control parameter 
a = \S\/NS = Nl/NS in MG(N c ,Nc) with different number 
of strategies S where N c = 37 and M = 2. The solid lines 
are the predictions of the crowd-anticrowd theory whereas the 
dashed line indicates the coin-tossed value. 

Fig. [l] shows the mean variance of attendance as a func- 
tion of the control parameter a in the MG(N C ,N 2 ) for a 
typical N c . For the MG(7V C ,N 2 ), the mean variance of 
attendance, E 2 , exhibits similar behavior as a function of 
the control parameter a to that in the MG no matter how 
many strategies S players have. In particular, whenever 
N 2 /NS « 1 , the mean variance E 2 is smaller than the so- 
called coin-tossed value. (Coin-tossed value is the mean 
variance resulting from players making random choices.) 
Thus, global cooperation amongst the players is observed 
in this parameter range. Moreover, Fig. |l| shows that the 
mean variance predicted by the crowd-anticrowd theory 
agrees with our numerical finding. 

Further results along this line, including the mean vari- 
ance of attendance as a function of the control parameter 
in MG(JV c ,Af c 2 ) with different strategy space S, will be re- 
ported elsewhere. These results all agree with the crowd- 
anticrowd theory [Q. Therefore, we conclude that we 
have successfully build up the MG(A r c ,iV 2 ) model when- 
ever N c is a prime power. 

Indeed, the MG(N C ,N 2 ) model can be readily extended 
to MG(N C ,N*) with N c is equal to a prime power for 
3 < k < M + 1. We found that the mean variance also 
agrees with the MG and the crowd-anticrowd theory in 



the MG(JV C ,JV*) Q. Thus we can always alter the com- 
plexity of each strategy in MG with fixed N, S and M 
while the cooperative behavior still persist. As a result, 
we can always keep (almost) optimal cooperation amongst 
the players in almost the entire parameter space. 

However, is it possible to construct a MG with N c al- 
ternatives whose strategy space size is smaller than iV 2 
that exhibits global cooperation? We give the answer 
by constructing the MG(N c ,nN c ) model where n is an 
integer less than N c . 

The basic setting of MG(N c ,nN c ) is the same as that 
of MG(iV c ,7V 2 ) except that the strategies are drawn from 
a different strategy space. More precisely, strategies of 
MG(N c ,riN c ) are picked from the set E>k = {X a v a + X u v u '■ 
X a £ GF(N C ),X U 6 K C GF(N C )} where K contains n 
elements. Moreover, v a and v u satisfy the two technical 
conditions in Eqs. ([!]) and (||). Clearly, the strategy space 
size of §k equals nN c . 

As shown in Fig. |^, the mean variance of attendance 
E 2 in MG(N c ,nN c ) shows similar behavior as a function 
of the control parameter a to that in the MG only for 
small a. When a increases, the mean variance E 2 in 
MG(-/V c ,77iV c ) becomes smaller than that in MG. Nev- 
ertheless, the numerical mean variance in MG(7V C ,?7A^ C ) 
does not agree with the prediction of the crowd-anticrowd 
theory except for small a. The inconsistency is more pro- 
nounced when a increases. 

To account for this discrepancy, we notice that as 
n — > 1 + while keeping all other parameters fixed, fewer 
and fewer (or even none) of the strategies in the strategy 
space of MG(-/V C , jyjVc) makes the same choice for the same 
combination of the output of the last M steps. Therefore, 
some of the choices can never be chosen for MG(N c ,nN c ) 
with small n when the number of strageties picked by 
the players are much smaller than the strategy space size 
wN c . In this circumstances, the attendances of most al- 
ternatives are either one or zero. Consequently, the mean 
variance E 2 in MG(N c ,nN c ) with small n is much less 
than N. In fact, the variance of a choice may even van- 
ished for large a. Such phenomenon will be more pro- 
nounced in MG(N c ,nN c ) with small n. Thus, the mean 
variance in the MG(N c ,r)N c ) for n <§; N c exhibits a rad- 
ically different behavior from the MG. From the above 
observation, we know that there is no effective crowd- 
anticrowd interaction whenever n <g; N c . And in this 
case, the dynamics in the MG(N c ,rjN c ) is no longer dom- 
inated by the interactions of the anti-correlated strate- 
gies. Consequently, the crowd-anticrowd theory docs 
not correctly predict the mean variance in MG(N c ,nN c ). 
Nonetheless, we still find that in MG(iV c ,?7iV r c ), E 2 attains 
a minimum (and hence the average number of winning 
players is maximized) whenever the control parameter 
a = |S^-|/A^,S' = nN c /NS « 1 for every prime power N c 
and 1 < n < N c . 

Now, we are ready to answer the two questions posted 
in the abstract. First, in order to obtain the best overall 
global wealth, players should switch to the MG(N C £N C ) 
game provided that N c < NS < N^ I+1 . More specifi- 
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FIG. 2: The mean variance E 2 (square) versus the control parameter a = \§>k\/NS = r/N c /NS in MG(N C ,7]N C ) with different 
r\ where 5 = 2 and M = 2. The variance of the attendance of a choice (cross) is also shown in the figure. The solid line 
indicates the mean variance predicted by the crowd-anticrowd theory whereas the dashed line indicates the coin-tossed value. 



cally, for fixed N c , N, S and M, players simply have to 
agree on an integer £ w NS/N C and the corresponding 
strategy space in order to ensure the best performance 
of the MG. Second, whenever £ > N c , the mean vari- 
ance of attendance £ 2 agrees well with our extension of 
the crowd-anticrowd theory. Thus, we conclude that in 
MG(iV c ,CiV c ) with N c < ( < Y C M , the origin of global 
cooperation is the self-organization of player's tendency 
to choose anti-correlated strategies in making their deci- 
sion. The "cancellation" of the actions in these mutually 
anti-correlated strategy ensemble leads to a small E 2 . 
Finally, we remark that results on the order parameter 



of MG(N C ,(N C ) will be reported elsewhere Q. Read- 
ers should note that in case N c is not a prime power, 
the presence of zero divisors in the ring Zat c invalidates 
the conclusion in Eq. (^). So, it is instructive to find a 
reasonable extension of MG(iV c ,iV 2 ) in this case. 
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